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ABSTRACT 


Error  correction  codes  have  been  designed  to  allow  the  communication  engineer  to  add 
a  degree  of  error  protection  to  transmitted  digital  data.  Difficulties  arise,  however,  when 
it  is  desired  to  obtain  maximum  efficiency  from  the  redundant  digits  added  to. a  particular 
channel.  This  report  illustrates  a  technique  for  evaluating  the  improvement  afforded  a 
fading-type  channel  by  the  use  of  a  bursr-error  correcting  code.  The  Gilbert  model  of  a 
fading  channel  is  then  evaluated  using  this  technique.  A  series  of  curves  are  presented 
showing  the  improvement  in  error  rate  afforded  this  particular  channel  by  a  burst-error  cor¬ 
rection  code  as  a  function  of  the  reduced  information  rate. 
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EVALUATION  OF  A  BURST-ERROR  CORRECTION  CODE 
ON  A  GILBERT  CHANNEL 

INTRODUCTION 

Several  means  are  available  to  the  communications  engineer  to  increase  the  probability 
ot  correctly  receiving  digital  infonnation  transmitted  over  a  noisy  channel.  Shannon’ 
proved  that  by  properly  encoding  the  information  it  is  theoretically  possible  to  communi* 
cate  over  a  noisy  channel  with  an  arbitrarily  small  probability  of  error,  if  the  transmission 
rate  is  less  than  the  channel  capacity.  Since  then  much  effort  has  been  concentrated  on 
developing  coding  techniques  that  will  approach  this  theoretical  limit  with  emphasis  on 
codes  which  can  be  easily  implemented. 

The  error  correction  capability  of  codes  generally  fall  into  one  of  two  basic  classes: 
random  error  correction  codes  and  burst-error  correction  codes.  A  random  error  correction 
code  will  correct  errors  that  occur  randomly  within  a  block  of  digits,  while  a  burst-error 
correction  code  will  correct  errors  that  are  grouped  over  a  span  of  digits.  In  both  classes 
the  error  correction  capability  is  obtained  by  adding  redundancy  to  the  information  by 
means  of  some  mathematical  algorithm.  How  much  protection  can  be  obtained  by  adding 
redundancy,  i.e.,  reducing  the  information  rate,  is  somewhat  obscure. 

One  would  suspect  that  burst-error  correction  codes  would  be  more  efficient  than  ran¬ 
dom  error  correction  codes  for  transmission  over  many  digital  channels  presently  in  use. 
This  results  from  the  observation  that  many  digital  channels  possess  a  certain  degree  of 
"memory*  so  that  when  errors  do  occur,  they  tend  to  be  grouped  over  n  span  or  burst  of 
digits.  Ry  inferring  that  errors  of  this  type  can  be  more  efficiently  corrected  by  a  burst- 
error  correction  code,  it  is  meant  that  a  given  degree  of  error  protection  can  be  provided 
for  a  smaller  reduction  in  information  transmission  rate. 

Corrington  and  Ausley2  have  performed  an  analysis  that  shows  the  decrease  in  proba¬ 
bility  of  error  on  a  binary  symmetric  channel  when  it  is  protected  by  a  random  error  correc¬ 
tion  code.  It  is  the  purpose  of  this  report  to  show  the  results  of  a  similar  analysis  per¬ 
formed  on  a  fading  channel  protected  by  a  burst-error  correction  code.  Curves,  that  have 
been  analytically  obtained,  are  presented  showing  the  amount  of  error  protection  provided 
by  a  burst-error  correction  code  as  a  function  of  the  reduced  information  rate  for  given 
noise  conditions. 

There  are  two  types  of  burst-error  correction  codes:  the  recurrent  codes,  such  as  the 
codes  designed  by  Hagelbarger’  and  Kilmer*,  and  the  block  codes,  such  as  those  designed 
by  Elspas.*  Certain  block  codes,  in  particular  the  shift  register-generated  cyclic  codes 
developed  by  Elspas,  are  capable  of  correcting  a  burst  of  digits  at  the  end  of  the  block  as 
well  as  a  burst  of  digits  at  the  beginning  of  the  block,  provided  the  sum  of  the  digits  in 
both  bursts  does  not  exceed  the  burst  correction  capability  of  the  code.  Error  patterns  of 
this  type  are  called  a  closed-loop  burst  of  errors.  If  a  burst-error  correction  code  cannot 
correct  this  particular  error  pattern,  it  is  called  an  open-loop  burst-error  correction  code. 

This  report  will  show  the  gains  achievable  through  the  use  of  open-loop  burst-error 
correction  codes  of  the  block  type.  Several  codes  are  considered  with  block  lengths  vary¬ 
ing  between  7  and  127  with  burst-error  correction  capabilities  varying  between  1  and  56. 

This  report  is  intended  to  supplement  the  first  interim  report  from  Stanford  Research 
Institute  under  RADC  Contract  AF30(602)-2327,  entitled,  "Design  and  Instrumentation 
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of  Error  Correction  Codes,  "  by  Bernard  Elspas.  In  this  report  Elspas  derives  the  equation 
for  the  probability  of  block  error  for  a  wide  class  of  channels  where  errors  occur  in  bursts. 
This  equation  is  used  as  a  basis  for  the  work  to  follow. 

MATHEMATICAL  MODEL 

The  mathematical  model  of  the  fadin/t  channel  used  for  all  calculations  described  in  this  paper 
is  the  model  derived  by  Gilbert.®  This  model  describes  tlie  channel  as  a  two-state  Markov  process, 
literally  a  "good"  state  and  a  "bad*  state.  When  die  channel  is  in  the  good  state,  no  errors  occur 
(the  probability  of  error  is  equal  to  zero).  When  in  the  bad  state,  errors  occur  with  finite  probability 
(1  •  k).  The  Gilbert  channel  is  illustrated  below. 


P 


P  is  the  probnbility  of  transL-r  from  the  good  to  the  bad  state  and  p  is  the  probability  of  trans¬ 
fer  from  the  bad  to  the  good  state.  TTie  probabilities,  P  and  p,  are  called  transition  probabilities. 

This  model  by  no  means  characterizes  all  burst-error  channels,  but  a  reasonable  description 
of  a  fading  channel  con  be  obtained  by  strategically  assigning  values  to  h,  P,  and  p.  Each  curve 
shown  in  this  report  ifi  clotted  for  constant  values  of  P  and  p.  The  probability  of  digit  error  in  the 
bad  state  (1  -  has  been  set  at  .5  and  kept  constant  for  all  calculations  shown  in  this  report.  This 
represents  the  worst  possible  cose  since  h  must  lie  in  the  range,  0  ^  (1  -  A)  :<  .5  .  This  assumption 
is  made  to  reduce  the  amount  of  compuration  and  does  not  bias  the  data  in  favor  of  the  error  correc¬ 
tion  capability  of  the  code. 

I.et  u(k)  be  the  probability  of  a  nin  of  at  least  k  correct  digits  following  the  occurrence  of 
an  error.  Gilbert  has  shown  that,  u{k)  =  ((P  +  hq)  u  (A  -  1)  +  A(p  ~  Q)  u  [k  -  2)  where 
Q  =  I  -  P;  9=1- p.  The  initial  conditions  are:  tt(0)  =  1  u(l)  =  p  +  hq.  Let  v{k)  be  the 
probability  of  a  run  of  exactly  k  correct  digits  following  the  occurrence  of  an  error.  v{k) 
satisfies  the  same  recursion  relationship  as  u(,k),  but  with  initial  conditions, 
t;(0)  «  (1  -  h)q,  v(l)  =  (1  -  A)  [pP  +hqi). 
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BURST-ERROR  CORRECTION  EFFICIENCY 


> 


« 


An  open-loop  burst  b  error  correcting  code  is  defined  as  a  code  capable  of  correcting 
all  possible  combinations  of  errors  that  occur  over  a  width  of  less  than  or  equal  to  6  digits. 
The  width  of  a  burst  is  defined  as  the  number  of  digits  from  the  first  digit  in  error  to  the 
last  digit  in  error  inclusive  within  the  message  block.  A  burst  b  error  correcting  code  can 
correct  all  errors  that  occur  within  a  span  of  digits  w  <  b  . 

Elspas’  has  shown  that  the  probability  (1  -  P'e)  that  an  n  digit  message  will  be  cor¬ 
rectly  received  when  it  is  protected  by  a  burst  b  error  correcting  code  after  transmission 
through  a  channel  described  by  the  Gilbert  model  is: 


(1-Pi)  -  P(l) 


^  a  (w)  % 

UIbI  tmU) 


u  (i  -  «>)«(»  -  i)  +  2 

t^n 


u(») 


.(1) 


P(l)  is  the  long  term  probability  of  digit  error.  For  the  Gilbert  channel  P(l)  is  defined  bv 
the  equation: 


P(l)  = 


2 

4-0 


u(k) 


(1  -  h)P 

(P  +p) 


a(w)  is  a  polynomial  function  of  the  v(t)'s  determined  from  the  possible  burst  patterns,  and 
is  determined  from  the  equation: 


a  (m  +  1)  >=  v(0)  o  (w)  +  v(l)  er  (m  -  1)  + 
By  definition  o  (1)  =  1  and  a  (2)  ■  v(0)  . 


,  +  v{u)  -  1)  o  (1) 


The  formula  for  (1  -Pi)  can  be  made  more  tractable  by  eliminating  the  infinite  summa¬ 
tion  in  the  following  manner. 


Since: 


2 

i  «0 


«(»') 


1 

P(l) 


then 


i  u(0 

t  =n 


l-l 


J _  -  r  u(i) 

P(l) 


(1  -  Pi)  =  1  +  P(l)  I  ^  cr  (id)  ^  u(,i-w)u(,n-i)  -  ^  tt(i 


W^l 


I 


I  sO 


(2) 
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We  are  concerned  with  obtaining  an  expression  for  the  reduced  information  rate  due  to 
the  addition  of  redundant  digits.  Campopiano^  has  derived  an  expression  for  the  maximum 
number  of  redundant  digits,  r,  required  for  a  burst  b  error  correcting  code  of  a  given  block 
length  n.  This  bound  is  (for  binary  codes), 


■■=  2(6-1)  +  logj  [b  -  2(6-1)]. 


If  there  are  k  information  digits  then  r  -  n-k  and  the  reduced  information  rate  is  k/n. 
We  can  now  solve  for  the  reduced  information  rate  in  terms  of  the  Campopiano  bound. 


for  6  <  2 . 


_  1  _  2(6-  1)^  loga  |b-  2(6-1) 


(3) 


n 


1  for  6  =  0. 

1  logj  (n  +  1) 


for  6  =  1  . 


(4) 


(5) 


This  bound  states  that  a  burst  error  correction  code,  using  this  many  redundant  digits, 
can  always  be  found.  In  some  cases,  more  efficient  codes  exist  that  will  correct  a  longer 
burst  for  a  given  redundancy  than  the  Campopiano  bound  would  indicate.  The  Campopiano 
bound  was  used  in  this  report  in  order  to  assure  the  existence  of  a  burst-error  correction 
code  for  every  point  shown  on  the  curves. 

The  expressions  for  both  k/n  and  (l-f'e)  have  been  developed  for  open-loop  burst-error 
correction  codes.  No  credit  then  is  given  to  codes  capable  of  correcting  a  closed-loop 
burst  of  errors. 

Digit  blocks  of  length  (2*-  !)  were  chosen  with  *  an  integer  in  the  range  3  <  *  <  8. 

For  these  block  lengths,  6  was  varied  in  the  range  0  —  6  ^  ,  with  6  restricted  to  be 

an  integer.  (1-F'e)  and  k/n  were  calculated  for  each  value  of  6  and  n  for  the  given  Gilbert 
channel  conditions. 

It  is  interesting  to  note  at  this  point  that  the  artifice  of  the  Gilbert  channel  was  used 
only  for  the  calculations  of  /"(I),  ti(k)  and  t>{k).  Equations  1  and  3  through  5  are  more  gen¬ 
eral  and  can  be  used  for  any  channel  for  which  these  statistics  can  be  obtained,  provided 
only  that  the  lengths  of  the  runs  of  error  free  digits  are  statistically  independent.  Gilbert 
has  indicated  whenever  this  independence  can  be  assumed,  a  more  elaborate  model  might 
use  the  distribution  of  v(A)’s  directly  as  parameters. 
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DATA  ANALYSIS 


The  data  .shown  in  this  report  were  computed  on  a  |turn>u^ht<  20!J  Digital  Conipi.te  and 
represent  the  solution  of  the  ei|untion  developed  by  lUspas  fur  the  probability  thai  a  e- 
coded  binary  digit  block  of  length  n  will  be  error  free  when  protected  by  a  burst  h  sm  i 
correction  code.  Those  v.-duus  were  plotted  for  vnrioim  values  of  h/n.  (I'igutes  I  i5.} 

Kxnminatinii  of  the  curves  would  lead  to  Nome  unusual  conc.lusionn.  Note  that  on  most 
of  the  graph.s  the  curves  hnve  obvious  cross-over  points.  In  order  to  make  thi.s  clearer, 
.several  of  the  graphs  have  been  plotted  logarithmicuMy  in  the  range  of  probabilities  be¬ 
tween  .90  and  l.O.  These  laguriihmic  plots  are  shown  ns  (nset.s  on  the  tanln  graph.  The 
fact  that  these  cutves  itave  cross-ovet  poinl.s  would  .seem  to  indicate  that  the  probability 
of  correctly  receiving  u  large  block  of  digits  is  greater  than  the  prohuhility  of  correctly 
receiving  n  smaller  block  of  digits  for  the  same  reduction  in  infoimaidon  rate  and  for  iihe 
same  noise  (.ondllioiis.  In  particular,  l-'igure  d  would  indicate  that  the  proboibility  of  cor¬ 
rectly  receiving  a  block  of  127  digits  is  greater  tliuii  the  probability  of  correctly  iccciving 
a  block  of  (i:!  digits  when  the  reduced  information  rate  ltc.s  in  tlie  range  .49  ^  k/n  .bb. 
Note  also  on  tliis  same  graph  ih.ti  more  blocks  of  127  digits  will  be  received  error  frt.‘ 
than  blocks  of  7  digits  for  k/n  •  .7^.  Similar  examples  ure  noted  on  other  graphs,  /t  is 
well-known  ihnt  greater  error  correeiioii  efficiency  can  be  obtained  by  transinittin);  tlu 
coded  information  in  longer  blocks.  1'liis  lm|>rovemcnt  is  shown  by  C'orrington  and  Ati<>lcy' 
for  optimum  decoditig  of  random  errors  ^  It  is  not  unrcan»nablc  to  expect  to  see  n  :>imi 
lar  impruvemrni  for  hurst  error  curteetiun  codes  used  on  a  fading  channel. 

I'he  cross-over  points  dtt  not  oeeur  in  the  same  position  on  all  tlie  graphs  hut  va  a-j 
tlic  iiuIno  conditions  are  changed.  This  would  Ir.-ad  to  llic  tliuught  that  there  exisrs  o'  r-p- 
timuiti  tdoek  lengili  for  a  single  Inirst-error  correriion  code  for  given  noinu  condition:,  and 
infurmniion  rntes. 

(ifcni  care  musi  he  taken  in  stating  that  a  given  block  length  Is  better  or  woroc  i.linn 
n  block  of  a  different  length.  Something  can  he  Niiltl,  however,  when  a  lunger  block  is; 
compared  with  a  shorter  one,  i.et  be  the  probability  that  a  block  of  length  Sj 

is  correctly  received.  Then  block  length  r^,  is  better  than  block  length  rtj  if 

and  s,  •  .  If,  however,  the  first  Inequality  were  true  <  Sj  , 

no  inlorination  could  oe  gained  us  to  which  of  ilie  two  block  lengths  would  be  the  bettor. 

CONCLUSION 

A  large  numlK'i  of  curvc.s  representing  (he  improvement  in  message  error  rnte  obtained 
through  the  use  of  burst-error  correction  codes  on  a  Gilbert  channel  are  presented.  Since 
many  channels  may  be  approximated  to  some  degree  by  the  Gilbert  channel,  these  curves 
may  be  useful  in  giving  the  communication  engineer  a  priori  knowledge  of  the  received  in- 
formneion  error  rnte. 

Although  these  curves  apply  only  for  the  Gilbert  channel,,  the  technique  used  is  v  ilid 
for  n  more  general  channel.  A  similar  analysis  can  be  performed  on  a  particular  charnel 
by  gathering  sufficient  data  to  statistically  approximate  the  parameters  ufA),  v(k)  and  P,^ 
provided  the  distribution  of  v(A)’s  is  statistically  independent. 
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